Against Chaos in Temperature 
in Mean Field Spin Glass Models 

Tommaso Rizzo 

Dipartimento di Scienze Fisiche, Universita "Federico 11", 
Complesso Monte S. Angelo, 1-80126 Napoli (Italy) 
e-mail: me2969@mclink.it 

March 2001 



Abstract 

We study the problem of chaos in temperature in some mean-field spin-glass models by means of a 
replica computation over a model of coupled systems. We propose a set of solutions of the saddle point 
equations which are intrinsically non-chaotic and solve a general problem regarding the consistency 
of their structure. These solutions are relevant in the case of uncoupled systems too, therefore they 
imply a non-trivial overlap distribution P{qTiT2) between systems at different temperatures. The 
existence of such solutions is checked to fifth order in an expansion near the critical temperature 
through highly non-trivial cancellations, while it is proved that a dangerous set of such cancellations 
holds exactly at all orders in the Sherrington-Kirkpatrick (SK) model. The SK model with soft-spin 
distribution is also considered obtaining analogous results. Previous analytical results are discussed. 

1 Introduction 

In this paper we shall address by analytical means the problem of the correlations between the equilibrium 
states at different temperatures of the Sherrington-Kirkpatrick spin-glass model. At any temperature 
below the critical one there are infinitely many pure states defined by the local values of the magnetization. 
The correlation between two states are measured by the overlap Qafi = wich according to the 

Parisi solution can take values between zero and some qea which is the self-overlap of the states 

While pure states at a given temperature are correlated, for many years it was believed that states at 
different temperatures were completely uncorrelated: this is the hypothesis of chaos in temperature. It 
was originally phrased as a constitutive ingredient of the phenomenological droplet theory ^ ^ , because 
otherwise the growth of domains of correlated phases would give strong cooling rate dependence and 
would not exibit the so-called rejuvenation effect. Contrary to this real spin glasses are to a large extent 
insensitive to the cooling rate; furthermore, if we let an observable relax at a given temperature in the 
glassy phase and then lower the temperature we observe that its value skips to a higher value and the 
system apparently rejuvenates. So everything seems to happen as if there were great changes in the 
free-energy landscape, i.e. chaos in temperature. 

A few years after the first observations of this phenomenon it was discovered that when the 
sample is heated back to the original temperature the observable resumes the value it had immediately 
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before the second quench therefore while the first effect suggests that tlie information befonging 
to aging at a higher temperature is destroyed upon coohng the system (chaos effect), the second one 
imphes no information loss at all (memory effect). The two effects are apparently contradictory and their 
explanation, particularly from a real-space point of view, attracts large interest ^, ^ . 

At the mean-field level it was shown that the equations of dynamics capture the physics of the two 
phenomena 0. 

From a phase-space point of view it seems rather difficult that a purely chaotic picture of the temper- 
ature evolution of the free-energy landscape could account for both chaos and memory effects and this is 
the main reason for our analysis of the equilibrium states correlations. We must be careful on this point 
since the theoretical work of the last ten years has raised many questions on the possibility of explaining 
off-equilibrium dynamics by means of the static mean-field free-energy landscape [0. At any rate, the 
ideas arising from the Parisi solution of the mean-field Sherrington-Kirkpatrick (SK) model have often 
proved to be very fruitful, for example in constructing phase-space pictures of dynamics like the traps 
model In particular a scenario which had been suggested as soon as the ultrametric organization 
of the states was discovered | |T^ was advocated in order to explain the rejuvenation and memory effects 
[ p^ . This scenario deals with the idea that each valley in the free-energy landscape bifurcates into many 
others when the temperature is lowered, so that rejuvenation is accounted for by equilibration between 
the newly born valleys, while memory is due to the fact that the topological structure of the states tree 
is preserved. The explanation of the two effects in this picture is completely different from the chaotic 
one and is supported by the fact that both rejuvenation and memory have been observed in numerical 
simulations on an intrinsically non-chaotic model like the GREM p^ . 

Our concern here is confined to check the existence of correlations between equilibrium states at 
different temperatures. We do not purport to give a full description of the structure, if any, of such 
correlations but merely to collect evidence that they do exist in contrast with the chaos hypothesis. 

Chaos is known to hold in mean-field models with different magnetic fields, while the case of equal 
temperatures has been treated by Sompolinsky in an unpublished work cited by Binder and Young in 
their 1986 review p^ . In that context it is claimed that there is chaos in temperature in mean- field 
spin glasses; we don't agree with these findings as we shall explain at the end of section 2. Kondor in 
1989 addressed a related problem, i.e. the spatial correlations between different temperatures states in 
finite-dimensional spin glasses. Since chaos was generally accepted at the time he was quite surprised 
in finding such correlations to be infinitely long-ranged at zero-loop order |l^ , a result that is deeply 
connected to our own. However, later Kondor and Vegso showed that at one-loop order the correlation 
length becomes finite fl7\ . 

The problem has also been studied by means of numerical simulations ^ ; our findings are in 

agreement with the recent work of Marinari and Billoire . The existence of correlations at different 
temperatures is well shown numerically, the problem is rather that rejuvenation is not seen in simulations 
of realistic spin-glass models |^ . Correlations between states at different temperatures have been recently 
studied also within the TAP approach |^ 

The paper is organized as follows. In the next section we shall present the model of coupled replicas 
of a SK spin-glass and discuss its relevance to the problem of chaos. In section 3 we shall write down 
the saddle-point equations and propose a set of solutions with a certain structure. The validity of such 
solutions has been checked perturbatively to fifth order in the order parameter and it turned out that 
they are non-chaotic i.e. their free energy at this order is the same as in the uncoupled case. We prove 
that at all orders these solutions, if they exist, are non-chaotic, showing that this property relies on their 
structure. Therefore the problem is to check wether the SP equations can be solved at all orders with 
solutions of these kind. To this extent we provide in section 4 an exact result concerning a particular set of 
cancellations in the SP equations showing that they are verified at all orders. This result is connected with 
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Kondor zero-loop expansion in replica field theory. However the possibility of solving the SP equations 
with the solutions we propose relies also on others concellations, and we are not able to prove that all 
these cancellations actually hold at all orders. 

Since the problem is to check wether the solutions we propose actually exist at all orders in section 5 
we investigate a mechanism that could led to a breakdown of the scheme at higher orders. The essential 
features of the problem can be explained starting from the SP equations. As we will see in section 3, the 
SP equations involve three n x n matrices Qi,Q2 and P that will be parametrized in the standard Parisi 
form. For instance, the SP equation obtained differentiating the free-energy functional with respect to 
Qi has the form 

TlQlab-Bab{Ql,Q2,P)=Q (1) 

Now, a necessary condition to solve the previous equation is that the second term B must have the same 
structure of the first term Qi, this is what we call structural consistency. Translated in the language 
of Parisi matrices, it means that if the function qi{x) has a plateau for x greater that some Ximax the 
function h{x) must have a plateau for x greater than the same ximax- For the standard Parisi solution 
it is easily seen that this is true because i? is a function only of Qi, but in our case B depends also on 
Q2 and P. If the functions qi{x),q2{x) and p{x) have different structures, i.e. they display plateaus of 
unequal lenght located at different positions, as in our case, it is not trivial that b{Qi, Q2, P){x) has the 
same structure of qi{x). We will see that in general this is not true, however we will prove that when the 
three functions qi{x),q2{x) and p{x) has the structure we propose for them the function b{x) has the same 
structure of qi{x)^ i.e. our solutions fuUfill the necessarity condition to solve the previous SP equation. 

This result is very general, it prevents the solutions we propose to break down due to structural 
inconsistencies. However it only states that BatiQi, Q21P) has the same structure of Qi, but doesn't say 
if it's really possible to tune the three functions qi{x) ,q2{x) and p{x) in such a way that BabiQi, Q2J P) is 
exactly equal to TiQiab in order to solve the SP equation (^. The arguments provided in section 4 and 5 
are two necessary conditions for the existence of non-chaotic solutions; they are completely independent 
since the first is quantitative while the second is qualitative, however none of them is sufficient to prove 
that the solutions actually exist at all orders. 

In section 6 the generalization of the SK model with soft spins will be studied evidencing again absence 
of chaos. In section 7 we give our conclusions. The solutions are reported in the appendix. 



2 The Model 

We consider a system composed of two replicas of a Sherrington-Kirkpatrick (SK) spin glass model 
constrained to have fixed values of their mutual overlaps. This model was first studied in the case of 
replicas of the same temperature ||24|; here we shall use the generalization to replicas with two different 
temperature below the critical one |20| . Denoting by 5'^'' the i-th spin of the r-th replica, we fix a constraint 

(2) 

i=l 

where N is the total number of spins. Including the temperature difference, the Hamiltonian of the 
system reads 

^ - - E J^^(P^SlSj + f32SfS]) (3) 

i<j 

So we take the same realization of the quenched {Jij} for the two systems. They are chosen with Gaussian 
probability, zero mean and variance jr. The partition function is restricted to those spin configurations 
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that satisfy (^. The constraint (^) is implemented introducing a Lagrange multipher e 



2- E y^exp 



N 



(4) 



Instead of fixing the constraint Qc we can consider the partition function corresponding to the following 
Hamiltonian 

N 

H{e) = - ^ J,, {(3,SlS} + P^SfSf) - e J] SlSf (5) 
i<j i=i 

this corresponds to systems coupled by a forcing term which selects configurations with higher over- 
lap. In the thermodynamic limit the two description are obtained one from the other by a Legendre 
transformation, in particular defining F = — In Z the following relation hold: 



dqc 



(6) 



Introducing replicas to average over the disorder we obtain via standard manipulation the average par- 
tition function to the power n 



= S.P. exp 



-N\nZ[Q] -Nq,Y,e^--Y,{^- 2P„„e„) 
^ 2 ^ /3i/32 



(7) 



Z[Q]^ J2 exp 



a/3 



a/3 



a/3 



(8) 



where by S.P. we mean the value computed at the saddle point with respect to the set {£„} and to the 

Qi P 



order parameter which is a x 2n matrix Q 
read 



P' Q2 



The saddle-point (SP) equations then 



QlafS — (SaSp) Q2at3 — {S^Sfj) 

Pap = {SlSl) + -^--ea&ap £a = PlP2{Paa - Qc) 
PlP2 



Where the square brackets mean average taken with respect to the Hamiltonian 



(9) 



(10) 



a/3 



a/3 



a/3 



The SP equation in the unconstrained case can be obtained setting e to zero and neglecting the last 
equation in (j^). We eliminate the Lagrange multipliers {ea} in (0) replacing their saddle point values. 
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This give for the e-dependent term in Z" 



To solve the model we need a variational ansatz for the matrices Qi, (52, and P. We choose each of them 
to be a Parisi hierarchical matrix, in particular this fixes Paa = Pd and ec, = e for any replica index a. 

Let us comment the relevance of this model to the problem of chaos. The mathematical formulation 
of the chaos hypothesis is 

WyMs^ = o (12) 

That is, any two equilibrium states at different temperatures have zero overlap. Now, absence of chaos 
would imply that there are pure states at different temperatures with non-zero overlap, so that we would 
have a non-trivial function P{qTiT2) that measures the probability of finding an overlap q between two 
pure states of systems at different temperatures weighed according to the Gibbs measure. Turning to 
our model, we see that if we choose the constraint inside the support of the function P{qTiT2) the only 
effect will be to select those couples of pure states that satisfy the constraining relation. As the number 
of pure states grows less than exponentially with N , selection of only some couples of pure states instead 
of all will not change the free energy or other extensive quantities. So in the absence of chaos we expect 
to find for some values of the constraint the same values of the free energy as in the unconstrained case 
(i.e. the sum of the free energies of the two uncoupled systems) while in the presence of chaos the free 
energy could increase. 

So far we have established that an increase in free energy implies chaos, but what if we find no such 
an increase? Let us show that this would imply a nontrivial P{qTiT2), i-e. absence of chaos. Suppose 
we find a set of solutions with the same free energy of the unconstrained case corresponding to values of 
the constraint qc spanning an open set from zero to some Pmax', then from (^) we find that for all these 
solutions the relation e = holds. Looking at the expressions of the free energy and of the saddle-point 
equations (H) we see that e = implies that these solutions solve the unconstrained two-system problem 
too. Now, it is well known that the P{q) of the single-system problem can be reconstructed from the 
matrix Q used to evaluate the free energy [|], one finds the following relations 



= J q^P{q)dq = ^mQlp (13) 

where the bar denotes average over all the solutions of the saddle-point equation . Indeed when replica 
symmetry is broken there is always more than one solution; given one of them others can be obtained by 
permutations of the replica indices. Following the same steps one can show that the function P{qTiT2) 

- ( Qi P , 

can be obtained from the order parameter Q = of the unconstrained two-system problem 

V P' Q2 

through the relations 

1tiT2= / <lTlT2Pi<lTlT2)dqTlT2 ^ 1™ f'a/J (14) 

Again the bar means average over all the solutions of the saddle point equations; we have of course the 
solution P = 0, Qi = Qifree, Q2 — Q2free, but Contrary to what sometimes stated nothing forbids the 
existence of solutions with a nonzero P. By looking at ( |l4| ) we see that we may not know all the solutions 
or how to average over them but what we do know is that the existence of solutions with P ^ implies 
a nontrivial P{qTiT2)- 
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As stated above, solutions of the constrained two-system model with the same free energy of the 
unconstrained one are solutions of the latter as well, so we can safely say that if these solutions exist 
there is no chaos in temperature, while, if they don't, pure states at different temperatures are completely 
uncorrelated. 

The fact that non-chaotic solutions of the constrained two-system problem are also solutions of the 
unconstrained problem is very important. As we saw, by this argument we can safely claim that if these 
solutions exist the P{qTiT2) is non trivial. Instead it will be dangerous to infer a non trivial P{qTiT2) 
only from the fact that the free energy per spin in the constrained case is equal to the sum of the free 
energy of the two uncoupled systems. We shall describe a situation where this recipe could lead to wrong 
results. 

The the spin-glass pure states have all the same free energy per spin but their relative weights, due 
to the correction of order are very different and only few states are relevant for physical quantities 
like the P{q). 

Now let us imagine a situation of weak chaoticity where the two complete sets of states at different 
temperatures are strongly correlated but the corrections of order are completely reshuffled: the few 
relevant states at T2 are located in a different portion of the phase space from that of the relevant states 
at Ti. Therefore in this situation we must have a trivial P{qTiT2), i-e. a delta function centered in 
zero. At the same time we will also have (non-relevant) states with a non-zero overlap between them. A 
non-zero constraint will select those couples of non-relevant states yielding the same free energy per spin 
of the unconstrained case, inducing one wrongly to think that the support of the P{qTiT2) is non-zero, 
i.e. that there is no chaos in temperature, while we assumed at the beginning that chaos in temperature, 
although weak, is present. 

The fact that there is a direct connection between the constrained and unconstrained cases ensures 
that the weak chaoticity picture described above is not possible and that by studying the constrained 
problem we always obtain sound physical information on the function P{qTiT2) of two uncoupled systems. 

Let us discuss the results reported in p^ ; rephrased in the context we have discussed, the method 
consists in studying the unconstrained problem expanding the free-energy functional (j^) as follows 

FiQ) = (Q) + AT^^(i) (Q) + Ar2F(2) (Q) + . . . (15) 

Where F^"^ is the functional at equal temperatures and AT the temperature difference assumed to be 
small. 

The unperturbed equal-temperature case is readily solved: the Parisi solution in its standard single- 
system form corresponds to Qi = Qstandard, Q2 = Qstandard, P = 9(0) = 0. The symmetry between the 
two systems definitely implies that solutions with a non-zero P can be obtained from the standard one 
by proper permutations of the replica indeces. Now, the perturbing terms in (|l^) break the symmetry 
between the two systems and one has to check whether they remove the degeneracy in free energy of the 
solutions. 

The free energy of each solution is evaluated in powers of AT substituting in (|l^) the zero-order 
equal-temperature solutions; by this procedure a free-energy difference to second order in AT is found. 
However, to second order one must consider the contribution to F that belongs to the splitting of the 
zero-order solution. Explicitly one must add the term 

CWab OLJab 

This term too is not permutationally invariant; therefore it might cancel the one belonging to the ex- 
pansion of F. While F^^^ has a simple expression evaluating exactly ( p^ ) it's impossible to the present 
knowledge. 
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However, the whole procedure seems unrehable for more general reasons. For instance, if we try 
to apply it to the standard single-system case we face the problem of the non-analytical temperature 
dependence of the Parisi solution q{x) caused by the presence of the plateau. If we think in terms of 
the hierarchical replica-symmetry breaking (RSB) scheme it can be realized that by trying to construct 
a solution starting from a different-temperature one we obtain a solution with the same break point i.e. 
a wrong one. 



3 Non-Chaotic Solutions 

Near the critical temperature the order parameter is expected to be small so that one can expand the SP 
equations (8) in powers of Q and then obtain approximate solutions in powers of the reduced temperature 
T = - T. 

By means of standard manipulations and a proper temperature-dependent rescaling of the order 
parameter {(3fQi Qit0iQ2 Q2,PiP2P P) we obtain the free energy up to fifth order 

F{Q) = - lim UtiTtQI + t^TyQI + It^^^yP'^ + ^-TyQ" 
+ i E Q', + ^TrQ^ - I Y: QlQl + |TrQ^ 

ab abc 



S 



^ QlbiQ%.a + ^ty] Q-UQ%b + ^{Pd- qcf} (17) 



2 



ab ab 



Where 



1 - T1T2 

Tl = T2 = — - — ri2 = (18) 



In the SK model we have uj^u^v~y — z^s = t = l. The only term that explicitly depends on 
the constraint is {pd — qcY = e^, so that a general strategy often employed is to fix the diagonal term in P 
and to solve the saddle-point equations belonging to the remaining components in Q. By this procedure 
we obtain a solution corresponding to the constraint 

qc=Pd -7. 19 

Opd 

We skip the expressions of the SP equations expanded to fifth order in Qi, Q2 and P. To a lower order 



they are reported in equations (36) and 

A first attempt to solve the equations was to set all the components of P as constant, this ansatz has 
a positive free-energy cost, i.e. chaos, independently of the temperature difference; however we know that 
non-chaotic solutions exist for equal temperatures , for this reason we have tried an ansatz for Q that 
could reproduce these solutions in the limit of equal temperatures. 

In the case of equal temperatures the solutions of the constrained problem are represented in figure (|l|); 
they display full Replica-Symmetry Breaking (RSB) in the matrix P and have a rather simple structure 

q2{x) = qi{x);pd^ qc for aU a; 

qi(x) = p{x) = qfreeC^x) <X < \xfree{Pd) 

qi(x) =p{x) =Pd \xfree{Pd) <X < Xfree{Pd) 
qi(x) qfreeix);p{x) = Pd Xfree{Pd) <X <l (20) 
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Figure 1: a qualitative sketch of the solutions in the isothermal case: qi{x) = q2{x) = q{x) for all x; 
p{x) = q{x) = qfreeC^x) for X < Xc, for X > Xc p(x) remains constant and equal to qc while q(x) after 
an intermediate plateau is joined continuously to qfree{x); qc can take value between zero and qsA- The 
diagonal value of P is equal to the constraint, i.e. pd = qc 



where qfree{x) is the free Parisi solution, and Xfree{q) is its inverse. The diagonal terms in P are equal to 
the constraint, i.e. qc — Pd- These solutions exist for any value of qc in the support of the function P(g) 
and have exactly the same free energy of the free case; actually it can be shown that they are particular 
permutations of the free single-system solution ||2^ . 

We want to remark that the structure of these solutions is intrinsically non-chaotic due to the equality 
p{x) = Pd for X > Xc- Indeed the SP equations read 

Pcp^iSlS}) +-^ec,5c,p ea =/3i/32(Paa -gc) (21) 
P1P2 

Now if we have p(l) — Pd we can make the permutation S\ which is not a natural permutation of 

the Hamiltonian, leaving the matrix Q unchanged. Since e appears only in the equation for the diagonal 
term Paa (i-e. Pd within the Parisi ansatz), this implies 

p{l) = {S\Sl) = {SlSD ^pd^ 6 = (22) 

So we see that ^g*-*^"-* = is true for all these solutions and noticing that they approach continuously the 
free solutions in tfie limit of zero constraint we can safely claim that all these solutions have the same 
free-energy of the free problem. 

As stated above, we have looked for solutions approaching continuously ( pO| ) in the limit of equal 
temperatures, so we made some variational attempts with finite RSB for the matrix P. Two facts 
emerged from this analysis: i) if we allow p{l) ^ pd the variational solution is always attracted by a 
solution with a positive free-energy cost independently of the temperature difference, so we discard it; ii) 
if we force the variational trial function to have p{l) = pd we always obtain a negative free-energy cost. 

This last result is absurd from a physical point of view since by imposing the constraint we are 
reducing the configuration space, but in a variational computation it may occur if our trial function 
doesn't approach enough the true maximum (one of the subtleties of the replica trick is that one has 
to maximize and not minimize the free energy). The fact that even very complex variational functions 
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Figure 2: a qualitative sketch of the solutions, in the small- a; region they are all different until the point 
Xc where p{x) = Pd = Qc, for x > Xc p{x) is constant and equal to qc, while qi{x) and q2{x) after 
an intermediate plateau are joined continuously to the corresponding free function; qc can take values 
between zero and some qcmax at which the two plateaus of the function at the higher temperature merge. 
At zero order the slope of the functions is 1 in the first region and 1/2 in the intermediate ones. 



showed negative free energy cost made us suspect that the maximum had zero free-energy cost, so we 
turned to directly solving the saddle-point equation near the critical temperature. 

Having in mind the equal temperature case, we looked at solutions with the structure depicted in 
figure : in the small- a; region the three functions qi [x) , q2 {x) and p{x) are all different till they reach 
the point Xc where p{x) = Pd — qc] then for x greater than Xc p{x) remains constant while qi{x) and 
q2{x) after an intermediate plateau are connected continuously to the corresponding free Parisi solutions. 
These solutions are thought to exist for values of the constraint from zero to a maximum value where the 
two plateaus of the function at the higher temperature merge (Ti > T2 in figure (^)). 

We postpone to section 5 the discussion of a consistency problem concerning such a structure for the 
solutions. 

In the isothermal case the functions in the small- a; region do not depend on the value of ^c, which only 
acts as a knife that fixes the position and length of the intermediate plateaus; to the order we compute we 
cannot say if this is true even for the two-temperature problem, but we believe that it is. It is important 
to notice that these solutions, provided they actually exist, intrinsically display a zero free-energy cost 
due to the equality p{\) = pd as in the isothermal case (see equation (p2[)). 

We checked that to the fifth order in the expansion in the order parameter it is possible to find non- 
chaotic solutions with the structure described above. In the following we sketch the essential features of 
the calculation. 

The expression for the free-energy functional truncated to the fifth order allows us to compute the 
functions to the second order in the regions before the starting point of the large plateau because these 
regions already span an interval of order one in the reduced temperatures. Instead, the value of the 
plateau can be evaluated to the third order as it spans a region of order zero in the reduced temperature. 

The saddle-point equations can be solved in terms of the Parisi functions qi{x),q2{x) and p{x) ex- 
panded in powers of x; one can then use the terms proportional to x^ and higher to determine the 
functions in the small-x region and the terms proportional to x to determine the value of the plateau. 
We determined the functions in the small- a; region and then checked such functions joined with the free 
Parisi solutions to satisfy the equations. 
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To the fifth order in Q the SP equations display terms proportional to x and to x^, plus constant 
terms due to the presence of the intermediate plateau for x > Xc- Having determined the functions in 
the small x region using the x^ terms we had to check nine coefficients to be zero: three proportional to 
X, one for each of the three equations for qi{x), q2(x) and p{x) in the small- a; region; two proportional to 
X in the regions of the intermediate x from the two equations for q\{x), q2{x); four belonging to the same 
regions corresponding to the x^ and constant terms. 

After a tedious but straightforward computation all these coefficients turned out to be zero. However, 
while the coefficients of a;, a;^, . . . in the equations for qi{x) and q2{x) are null independently of the value 
of LO,u,v,y. . .the corresponding coefficients in the equation for p{x) only cancel provided the following 
relationships hold 

1- — - i- + ^^+ =0 23 

The constant terms in these relationships are the coefficients of (ri — T2)^ and (ti + T2)(ti — T2)^ in the 
expansion of 4ti2. 

The free-energy difference has been evaluated either directly on the maximum and both thermody- 
namically integrating the energies (that have a much simpler expression in the order parameter) with 
respect to the temperatures. It turned out to be proportional to the left-hand sides of (|2^), so that it is 
zero when relations ( ]23| ) hold. This is consistent with the previous statement that the structure of the so- 
lutions is intrinsically non-chaotic; indeed, it implies that we cannot choose the coefficients lo, u, v,y. . . to 
have a positive free-energy cost and at the same time to satisfy the saddle point equations. 

The expressions of qi{x), q2{x) and p{x) in terms of w, u, v,y. . . are reported in the appendix. 



4 Exact Results: the Constraint-Independent Cancellations 

In this section we prove that a particular set of cancellations in the SP equation of p{x) is verified at 
all orders in the SK model. Expanding the equation in powers of x, we must find that the coefficient 
of each power equals zero. We concentrate on the coefficient of x, and in particular on those terms in 
the coefficient of x that do not depend of the value of the constraint qc, but only on the temperatures of 
the two systems. These terms must sum up to zero. It will be proven that these constraint-independent 
cancellations hold at any order in the SK model. We will see that these cancellations are the origin of the 
relationship (p3|); this means that going to higher order we will encounter relations between the coefficient 
like ( |2^ ) such that they are verified by the corresponding coefficients of the SK model. 

One should not forget that to verify the SP equations others cancellations should be checked at all 
order, while they have been checked only to lowest orders in the computation reported above; however it is 
interesting to notice that at the order we computed we found that these cancellations hold independently 
of the parameters uj,u,v,y. . .so one may conjecture that at higher orders they can always be fuUfiUed 
by opportunously tuning the functions in the small-x region. According to this conjecture for any given 
spin-glass model the only relevant condition for the existence of the non-chaotic solutions is that the 
constraint-independent cancellations we consider here hold at all orders. 

The free energy can be written as the sum of the free-energies of the free problem plus a term 
proportional to P which reads 

F{p) = - hm ^mAp') + 1 E + l^'P" - y E p'^p"^ 

ab abc 

+zTrp4(g^ + Q2) _ ^Trp2(Q^ + Q2)Trp2 + V (PQi + PQ2)ab} (24) 
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Aab = (2ti2 - f (TrQ2 + TrQ^) _ ^(TrQ? + TrQ3))<5^, + ^(Q^ + Q^)^, 

+v{Ql + QI + QiQ2)ab + ziQl + QI + QiQ'l + Q^QDab (25) 
(TrQ2)(2Qi + - f (TrQ2)(2Q2 + Qi),, + |t(g3^^ + QlJ 

The equation one obtains differentiating with respect to P is 

dFiP) 2 1 

- - {AP)ab + gt^Pa'fc + «(^')a6 " yPa6((P')aa + (P')6b) + 6ab = (26) 

fn the last equation we neglected the fourth order terms which contain powers of P greater than one as 
in reality their order is higher. We are assuming that Qc is of the order of magnitude of the self overlap 
in the free case i.e. of the order of ri and T2. The structure of the matrix P (explicitely the equality 
Pd = p(l)) implies that even if P is of order one its powers P„ are of order 2n — 1 and not of order n. 
Being [p^f' , p^"^ {x)) the Parisi function associated to P", we know that the quantity p^"-* — p^") equals 
{Pd — py^ i-e. it's proportional to q^". Now p^"''^{x) is different from p^"-* only on a region of order one 
and we see immediately that P„ must be of order 2n — 1 in Qc- 

Expressing ( p6| ) in qi{x), q2{x),p{x) and expanding in powers of x we have terms proportional to x 
and in the small- a; region. We determined the function p{x) using the x^ terms and thus we must 
check the x ones to be zero, these are generated by {AP)ab and Pab{{P'^)aa + {P'^)bb)- Then the equation 
we have to check is 

(fld - a)p{x) + {pd - p)a{x) + 2{pI - p-^)p{x) = (27) 

where (0^,0(2;)) is the Parisi function associated to the matrix A defined in (p5|). This equation must 
really hold only for the terms proportional to x and we may more correctly write it substituting q{x) and 
p{x) with their derivative in zero eliminating the x-dependence. 



The l.h.s. of (27) displays terms explicitly proportional to powers of qc and others that depend only 
on Ti and T2; the former terms cancel irrespective of the values of w, u, w, y . . . while the latter sum up to 
zero provided that the relations (^) hold. 

Since at zero order we have p'(0) = 1 it is easily seen that these constraint-independent terms belong 
only to {oLd — a). It is quite natural that their cancellation depends crucially on the structure of the model 
(i.e. on the coefhcients U!,u,v,y . . .) because they cannot be controlled by properly tuning the solutions 
in the small- a; region. For completeness we report the gc-independent terms belonging to the quantity 
ad — a evaluated directly from ( p5| ) which is the origin of the relationships ( p3| ) 

1/ ,9 I f 'iv'^ 2z 2vy 2s\ , 

-^-----A'-^)ir^-r.f + -^[l-^ + -,-Jr + -,){r^+r2)[r,^r2f (28) 

We will prove that the constraint-independent terms in — a are null at all orders in the SK model. 

According to the previous discussion the matrix A is defined as the sum of all the P-independent 
matrices X that appears in the free-energy functional in the form TrXP^ (actually the expression ( p5| ) 
is truncated to third order in the order parameter, because it is derived from (^ which is in turn the 
free-energy functional truncated to the fifth order). Therefore A it's related to the second derivative of F 
with respect to P. By direct inspection one verifies that Aam^bn is equal to d'^F / dPabdPmn plus terms 
that depend explicitly on P. We are interested in the gc-independent part of A so we can consider the 
limit — * where they become equal. Therefore we have to compute d'^F/dPabdPmn in the limit of 
zero constraint (i.e. P ^ 0). The solutions reduce continuously to the free ones in this limit so we can 
safely compute it for P = 0. 
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Since d^F/dPabdPmn is a component of the Hessian of F, it is the main ingredient to calculate the 
spatial correlation functions between states at different temperatures of a finite-dimensional spin-glass in 
a Gaussian approximation around mean-field theory. In this context it has been previously computed by 
Kondor [ p^ ; therefore the particular cancellations we are dealing with are exactly verified at all orders 
for much the same reason that at zero-loop order the overlap of the spin correlations at two different 
temperatures is infinitely long ranged, whatever the difference between them. 

One can easily convince himself that, when P — 0, (a^ — a) is proportional to the minimum eigenvalue 
of d^F /dPabdPmn i-G- to the inverse of the correlation length. Therefore the computation we shall sketch 
below is a completely equivalent rephrasing of Kondor's computation. 

Let us proceed to evaluate {ad — a); following Kondor, we start noticing that the Hessian is related 
to the four-point connected correlation functions 

nTiT^AarnSbn - ^TiTa ^/'^ = SabS„^n - {{S'^ S'^S^ - {S'^S'^) {S^S^)) (29) 

dPabOPrnn T1T2 ' 

The first identity holds because P is zero; exploiting again this relation we can evaluate the r.h.s. of ( p9| ) 

nTiT2AarnSbn — ^ab^mn ~ rr^ ^ {SamSbn + <^am(l ~ ^bn)Q2bn 

+Sbn{^ — Sa,7i)Qlam + (1 ^ Sam){l — 5bn)Q2bnQlam) (30) 

Aab = ^(j4a,„(5b„)^,„„ = 2rp2 (^1^2 ^ ^ ^ Qlab — Q2ab — {QlQ2)ab) (31) 
mn ^ ^ 

Now, given a generic ultrametric matrix A, the quantity ad — a is the eigenvalue corresponding to the 
eigenvector with constant coordinates so we have 



1 

rp2rp2 

^1^2 



ad-d= T^{TiT2 - 1 + gi + 92 - (9i)(g2)) = (32) 



Where in the last identity we used the exact relation |g6[ qparisi = 1 — T. Note that this relation holds 
because we have assumed that in the large-x region the functions qi{x) and 92(2;) are exactly equal to 
the standard Parisi solutions at the corresponding temperatures. 



5 Structural Consistency 

In this section we discuss a problem of consistency related to the structure we propose for the solutions. 
The essential features of the problem have been presented in the introduction. It can be view as a 
necessary, but non sufficient, condition to solve the SP equations. We will show that this necessary 
condition is fuUfilled at all orders by the solutions we propose. As said in the introduction this result is 
completely independent on the result of the previous section. 

In the following we will use the SP equations expanded to the lowest order sufficient to clarify the 
nature of the problem but the results we will obtain are valid at all orders. The saddle-point equations 
for the single system problem read 

2TiQab + iQ^)ab + '^Qlb + (Q')a6 " QabiiQ^)aa + iQ^)bb) + ... - (33) 

the l.h.s. is a sum of all the possible covariants of Q. A covariant is a two-index object built in a 
permutational covariant way from the matrix Q; given any permutation tt between the replica indeces 
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Figure 3: (a) A simple hierarchical matrix composed of nine blocks of the same size with l—2=3—qD and 
A—B—C=qoD- The matrix is invariant under block permutations like those represented in (6, c), they 
can be used to prove separability. 



the mathematical definition of a covariant M is 

M{ttQ) = TrM{Q) (34) 

If the matrix Q is a hierarchical matrix, all its covariants are hierarchical matrices with the same structure 
of Q, i.e. with the same set of block indexes to's; for instance, if the Parisi function q{x) associated to 
Q has a plateau for x greater then some xi the Parisi functions associated to any of its covariants will 
display a plateau in the same region. 

This property of the Parisi matrices can be understood by looking at figure (^: we have a simple 
hierarchical matrix Q composed of nine blocks of the same size; the components of a single block are all 
equals, the three blocks on the diagonal are equal to qn and the six blocks off the diagonal are equal to 
qoD- 

In figure (|^) two blocks permutations are also represented which leave the matrix Q unchanged; these 
permutations can be used to prove that any covariant of Q has its same structure. For instance, if we 
consider the first permutation and apply to it the definition of covariant (^) together with the fact that 
this permutation verifies tt{Q) = Q, we obtain that ttA/ = M; Since this permutation exchanges blocks 
1 and 2, the blocks corresponding to 1 and 2 in M are equal, as the blocks corresponding to B and C; 
using other permutations of this kind we can prove that any covariant M is a hierarchical matrix with 
the same structure of Q. 

This property goes under the name of separability or overlap equivalence [|25[| because of its physical 
meaning; it is not clear if it's a condition to solve the saddle-point equation, but, together with stochastic 
stability, it's likely to be the origin of ultramctricity. 

The SP equation for two systems at different temperatures read 

2 I ^''^ I + (Q')afc + iQlt + iQ%b + . . . = 0; (35) 

\ naP T2Q2 / , 3 

\ / ab 

Where the indeces (a, b) range from 1 to 2n. All the terms -excluding the first- in the previous equation 
are identical to those of the SP equation for a single system (|3|), provided one substitute the covariants 
of Q with the corresponding covariants of Q. Expressing the covariants of Q in terms of Qi, Q2 and P 
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the previous equation reads 



TlQl ab TuPab \ , / (Q? + P'')ab (P(Ql + Q2))ab \ 2 ( Qf ab P^b 

ab ^2 ab 



TuPab T2Q2 ab I \ {P{Ql + Q2))ab {Ql)ab I ^ \ P^b Ql 



(P3 + P(Qf + g2 + QiQ2))ab {Ql + P'(2Q2 + Ql))ab 



(36) 



Where the indeces (a, 6) range from 1 to n. According to the previous equations we have that the equation 
for Ql reads 

2TiQiab + {Ql)ab + Pab + \Q\ab + {Q\)ab + ((2Ql + Q2)P')afc + • . . = (37) 

Notice that P always appears in even power in the invariants of the free-energy, this is connected with 
the fact that each mute index of Q must appears an even number of times in zero magnetic field. 

The consistency problem we want to address is that the previuos equations do not admit a solution 
for any parametrization of the matrices Qi, Q2 and P. 

Let us start considering the simplest case where Qi, Q2 and P are IRSB Parisi matrices with different 
breaking points. If we want to solve (|3^) to second order we must consider its first three terms. The first 
two are IRSB matrices with breaking point xq-^ , while the second is a IRSB matrix with breaking point 
xp. If they are to sum up to zero the only two possibility are: a) P = 0, which is the trivial one, or b) 

XQi = Xp. 

Going to next order we encounter the last term in which also Q2 appears, and again if we want a 
solution with P 7^ we must impose xq^ — xq^ = xp. Therefore before solving ( ^7| ) we already know 
that the only consistent non-trivial solution must have all equal breaking points. 

Generalizing to an arbitrary number k of RSB steps we found that a consistent parametrization for 
the matrices Qi,Q2 and P can be obtained fixing 

mf^^mf'^m[ Vi = l,...fc (38) 

In the limit of infinite RSB steps the three matrices are parametrized by the functions qi{x), q2{x) and 
p{x) which are continuous and can eventually display constant parts (plateaus). In this case the consistent 
parametrization (^8|) corresponds to imposing that if one of the three function displays a plateau the other 
two functions must display a plateau of the same length located at the same position. 

Looking at figure (^ it is clear that our parametrization is not of the type described; thus we must 
check its structural consistency. To clarify what kind of problems we may encounter with such a structure 
for the solutions let us go back to equation (^7|). 

To second order we must retain the first three terms. For x < Xc we have no problems because all 
the three terms are varying, for x > Xc P^ became constant but as Qf has the same structure of Qi we 
should reasonably be able to solve the equations. 

The problems arise at third order due to the presence of the last term which is proportional to Q2 ■ 
Let us consider the region of the second plateau of the function qi (x) in figure (||) . In this region all the 
terms in ( |37| ) that depend on P and Qi are constant because qi{x) and p{x) are constant. Instead the 
last term {2Qi + Q2)P^ that depends on Q2 will vary in general until the point X2max where the second 
plateau of q2{x) starts. 

Clearly if {2Qi + Q2)P^ varies, equation ( |37| ) cannot be verified in both the two regions ximax < x < 

•^2m,ax and X2max ^ X ^ \. 
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The same problem is present in the region between the ending point of the intermediate plateaus of 
qi{x) and 92(2^), in which as one function varies the other is constant. 

In a few words, the problem is that the equation for qi{x) displays terms depending on q2{x) which 
for X > Xc have a completely different structure. The same problem is present for the equation of q2{x) 
and p{x). 

In the following part it is shown that the equality — pd allows us to solve these problems of 
structural consistency at all orders. For instance, it implies that all the terms of the form P'^^Q\Q2 
display a plateau for x > Xc so that any dependence on the structure of qi{x) and q2{x) in this region is 
removed. 

The last statement can be checked by direct inspection evaluating the product AP given that P 
satisfies p{x) — pd for x > Xc and ^ is a generic Parisi matrix. It turns out that this product has the 
same structure of P, i.e. we have {ap){x) — {ap)d for x > Xc- 

In general through p{x) = pd the l.h.s. of ( |37| ) can be recast order by order as a sum of Parisi matrices 
that have exactly the same structure of Qi, even if they depends of P and Q2. The same is true for the 
saddle-point equation of Q2 and P. 

These recasted terms are just the corresponding components of the covariant of Q. For instance, in 
the equation for Qi the corresponding component of the covariant is (Qf + P^{2Qi + Q2)- The first 
term has the structure of Qi with two plateaus located at the same position while the second is constant 
for x > Xc, consequently (Qf + P^(2Qi + Q2) has the structure of Qi. 

In other words, structural consistency is ensured because when p{l) ~ pd the matrix Q is separable. 
Writing one of its covariants M (ff) as 

M(Q)H M.2^Q.M.P) 

A/l2(Ql,Q2,P) M2{Ql,Q2,P) 

separability for Q means that Mi{Qi, Q2, P) has the same block structure of Qi, M2(Qi, Q2, P) has the 
same block structure of Q2 and Mi2(Qi, (52, P) has the same block structure of P. 

In general, a matrix Q composed of three hierarchical matrix Qi, Q2 and P is not globally separable; 
a sufficient condition for this is that the three matrices have the same structure, i.e. that they verify 
equations (^8|). This however is not our case. 

To prove that the equality p{l) — pd a. sufficient condition for the separability of Q let us take a 

look to figure (H). Here the matrix Q — \ ) is sketched qualitatively according to figure (0). 

\P' Q2 j 

The block index rUc in figure (jj) corresponds to Xc in figure (^). For mc < ni < n {0 < x < Xc) the 
three matrices Qi, Q2 and P have the same structure i.e. the same set of rn's (for simplicity in (jj) there 
is only the intermediate index rrii between mc and n). 

For 1 < m < TOc {xc < x < 1) the n/nic blocks of size rUc in Qi have an internal structure different 
from the corresponding n/nic blocks in Q2, while the n/nic blocks in P have all their components equal 
to Pd- 

In particular the crossed blocks in Qi are identical to the blocks of the same size in the standard 
Parisi solution at temperature Ti; Those in Q2 correspond to the standard solution at T2. 

If we consider one of the blocks of size rric in the matrix Qi, say the first, we can make permutations 
like those of figure (|3|) between its inner blocks leaving Qi unchanged. The invariance under this block 
permutations ensures that any covariant of Qi has the same structure of Qi. 

Now, to a block of size mc in Qi corresponds a block of size mc on the diagonal of P components of 
which are all equal to pd, this ensure that not only Qi but also the global matrix Q is left unchanged by 
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Figure 4: The global matrix Q. The block index rric corresponds to Xc in figure (|^). For nic < m < n 
{0 < X < Xc) the three matrices Qi,Q2 and P have the same structure, i.e. rrii is identical for the 
three matrices. For 1 < to < rUc {xc < a; < 1) the n/rric blocks of size rric in Qi have a different 
internal structure from the corresponding n/mc blocks in (52, while the n/nic blocks in P have all their 
components equal to pd- 



the same block permutations. 

We recall how separability follows from the invariance under these block permutations. Invariance 
means ttQ = Q] so the definition of covariant, i.e. M{-kQ) = 7rM((5) implies ■kM{Q) = M{Q)\ these 
permutations exchange blocks of M{Q), so that the last equality means that these blocks are equal and 
M{Q) have the same structure of Q. 

In other words, the structure of a matrix like Q or M{Q) is univoquely determined by the set of block 
permutations that leave it unchanged, and the equality p(l) — pd implies that the set of invariant block 
permutations of M{Q) coincide with that of Q. 

Instead if pd ^ in order to leave P unchanged under the permutations between the internal 

blocks of, say, the first block of size TOc of Qi, we should make the same block permutations on Q2. Since 
Q2 has a different block structure from Qi, it would not be left unchanged. 

6 The SK Model with Soft-Spin Distribution 

In this section we shall apply the approach of coupled replicas to the generalization of the SK model to 
soft spin distribution. This model can both be mapped onto the SK model by a proper redefinition of 
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the parameters w, u, v,y. . . appearing in the free-energy functional (p7|). 

In the case of continuous spins each invariant belonging to the term In Tr exp X^ab Q'^aSt in the 
free-energy functional must be multiplied by a proper product of cumulants of the soft-spin distribution. 
Rescaling the order parameter by a factor (5^) the mapping goes as follows 



IjJ ^ ui = 1 V 



y^y 



(52)2 ^52)2 



^-^ = |J|J (40) 

Therefore the two relations (^ ) keep on been satisfied and to the order we computed absence of chaos 
it is stable against soft spin distribution. It is important to remember that the constant terms in (^) 
belong to the expansion of ri2 in powers of ti,T2, which is the same as in the SK model because of the 
rescaling of the order parameter. Let us comment that for technical reasons, to consider the free energy to 
the fifth order allows us to obtain a result valid up to sixth order. We showed that the relation p{l) — pd 
implies exactly e = 0; this statement can be checked at all orders by using the saddle-point equations for 
p{l) and Pd substituting the first into the second one obtains 

e = 2{pd - p(l)) (^ad - a(l) + ^(^^(l) +pl+pil)pd) + 2v{pf - p'^^^l)) - 2ypf^ (41) 

So e is equal to the difference between p{l) and pd multiplied by a second-order factor so that if we prove 
that p(l) = Pd to the order n, the free-energy difference will be zero at least at order n + A. 



7 Conclusion 

The present paper's main results has been to phrase a consistent analytical picture for absence of chaos 
in temperature in mean-field spin glasses and to collect evidences through direct computation that this 
picture actually holds. 

We made use of a model of two coupled systems that through the replica trick can be phrased as 
a variational problem with an order parameter analogous to the standard one. We proposed a set of 
solutions of the model, and showed that they are intrinsically non-chaotic due to their structure. The 
actual existence of these solutions is therefore the main problem, it has been checked to fifth order in the 
reduced temperature for the SK model and for its generalization with soft spin distribution. 

A particular set of cancellations in the saddle-point equations turned out to hold through subtle 
relations between the parameters of the models; however, it was proven that they hold exactly at all 
orders in the SK model in connection with the zero-loop expansion of replica field-theory [p^ . 

Other cancellations were checked only at finite order: they constitute the main open problem. In this 
respect we recall that the failure of some cancellation, even at a very high order, will destroy the whole 
construction leading to a dramatic change in the physical picture. The solutions will become unstable, 
therefore, even near the critical temperature, the function P{qTiT2) will reduce in the thermodynamic 
limit to a ^-function centered in zero. 

We also considered the possibility that the non trivial structure we propose for the solutions be 
incompatible with the SP equations. In the introduction we phrased the problem through the notion of 
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structural consistency. It is a necessary condition to solve the SP equations. We have proven that the 
solutions we propose satisfy this condition at all orders in the expansion in powers of the order parameter. 
Furthermore, this condition imposes that the corrections one obtains considering higher powers in the 
expansion in the reduced temperature, change the solutions quantitatively but not qualitatively. In 
particular, the relation p{x) = pd for x > Xc holds exactly, the approximation is in the exact value of Xc- 
Also the starting points of the intermediate plateaus of qi (x) and q2 (x) at all orders are exactly equal to 

Xq . 

Though these solutions were obtained in the context of coupled systems, they are solutions of the SP 
equations for uncoupled systems too. Therefore they enter the average over solutions in equation (|l^) 
implying a non trivial P{qTiT2)- 

However, we warn the reader that nothing like the relation P{q) = dx/dq can be written for these 
solutions. This relation follows from the possibility of substituting the average over solutions in ( p^ with 
a summation over the indeces evaluated on the standard Parisi solution. Instead, in the case of two or 
more systems this is impossible because the various solutions cannot be obtained one from the other by 
a permutation of the indeces . 

What is implied by our results is that P{qTiT2) has a non-zero support from zero to a maximum 
value Pmax = qi max + 0(t'^), whcrc qi max is the self-overlap of the states at the higher temperature. 
The small positive corrections to this last relation remain small at any temperatures; actually it can 
be proven that Pmax = qi max holds at all temperatures at the level of accuracy of the Parisi- Toulouse 
approximation [2^ . 

On general grounds it is reasonable that, like the standard Parisi solution, these solutions encode much 
more information than the mere value of the free energy; actually it seems that they lead to a quantitative 
description of the bifurcation picture for the free-energy landscape discussed in the introduction ||2^ . 
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Appendix 

In this appendix we report the solutions as evaluated by solving the saddle-point equations to fourth order 
in the reduced temperatures for a given constraint qc intended to be of the same order of magnitude of 
the self-overlap of the states (i.e. ri or T2). From these expressions the maximum value of qc can be 
readily obtained as the value for which the first and the second plateau of the function corresponding to 
the system at the higher temperature merge. 

f u 3uv — Stuj , , 
for < X < qc - + TT-^ (ri + ra) 

, , (4ri + 2t2)uv - (12ri -|- AT2)tuj 
qi[x) = 

, , / UJ 3(ti + T2)UV - 8(ti + T2)tuj 

p{x) = - 



u 2u'^uj 
I u iuv — 8tuj \ f 2u buv — \2tuj uv — Atu 

'^^ ' w ^ — 2^^ — + T2) I < x < ( — + — n + — — — T2 



qi{x) = [l- '^l^ (ti - T2) ) qc\ p{x) = qc 

' 2uuj'^ ' 
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for qc\— + ^ Ti + T2 ] <x< + ^ (u(2tt + 3w + 2y) + 6mz; - 16tw) 



, . / 6m?; — Votuj I 

' 2m 4M^ti; 



2mti 

for — ^ + -\ {u{2u + 3v + 2y) + &uv - 16iw) < a; < 1 

, , Ti t?(2u + 3m + 2w) t? , , , 
LO 2u:-^ 24uj-' 

~6Auy - UAvy - A8y^ + UOslo + 208iw + 48zu;); p{x) = 

The function q2 (x) can be obtained from qi (x) exchanging ri with T2 . Given that the higher temperature 
is Ti, the maximum value of qc for which the solutions exist works out to be 



16tuj — 6uv . , 

9c max = 9l max H . n n ('''2 — T\)T\ 

Au^lu'' 



The above expression is valid to second order in the reduced temperatures since the total number of 
matrix elements with value qc is of order one due to the equality p(l) = Pd- Therefore to first order the 
maximum overlap it's equal to the self-overlap qEA of the system at the higher temperature with positive 
higher-order corrections. 

This quantity is accessible to direct measurement in numerical simulations and a comparison can 
be done provided that the trivial order-parameter rescaling which has led us from (|^) to (17) is taken 



into account. It's important to notice that this rescaling doesn't change the qualitative behaviour of the 
solutions, in particular the three functions qi{x), q2{x) and p{x) remain different in the small- a; region. 
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